-
Notifications
You must be signed in to change notification settings - Fork 2.1k
fix(streaming): Remove retry wrapper from chat model stream methods #3524
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
fix(streaming): Remove retry wrapper from chat model stream methods #3524
Conversation
Removes the `retryTemplate.execute` wrapper from the `chatCompletionStream` calls in MiniMax, MistralAI, and ZhiPuAI chat models. Signed-off-by: Alexandros Pappas <[email protected]>
Signed-off-by: Alexandros Pappas <[email protected]>
|
@apappascs The PR build fails - can you please take a look? https://github.com/spring-projects/spring-ai/actions/runs/15634414758/job/44072094143 |
Signed-off-by: Alexandros Pappas <[email protected]>
|
thank you @sobychacko I am working on that. need to disable a few tests. |
|
@apappascs Curious why you disabled those tests. Did your changes make those tests fail? In that case, we need to investigate why that is the case and address it accordingly. If we leave these tests disabled, we risk missing regressions that would normally be caught by these tests, including failures unrelated to the current changes. |
Very valid points @sobychacko . I sould have linked this issue |
|
@chemicL thoughts? |
#1193 (comment) |
|
Thank you for the input @chemicL . I think this alone, as you mentioned, does nt really do much. We discussed last year about removing the retry from streamable calls because it didn't work properly as we expected. I followed the same pattern we have for the non streamable calls: And your comment added to the context: @markpollack @tzolov This is still open. |
Removes the
retryTemplate.executewrapper from thechatCompletionStreamcalls in MiniMax, MistralAI, and ZhiPuAI chat models.following up on this comment #1852 (comment) from @markpollack